Gibbsian theory of power law distributions 



R. A. Treumann^* and C. H. Jaroschek**LiJ 

^ Department of Geophysics and Environmental Sciences, 
Munich University, D-80333 Munich, Germany 
** Department Earth & Planetary Science, 
University of Tokyo, Tokyo, Japan 
(Dated: February 8, 2008) 

Abstract 

It is shown that power law phase space distributions describe marginally stable Gibbsian equi- 
libria far from thermal equilibrium which are expected to occur in collisionless plasmas containing 
fully developed quasi-stationary turbulence. Gibbsian theory is extended on the fundamental level 
to statistically dependent subsystems introducing an 'ordering parameter' k. Particular forms for 
the entropy and partition functions are derived with super-additive (non-extensive) entropy, and a 
redefinition of temperature in such systems is given. 
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Power law phase space distributions of charged particles are at the heart of co 
plasma physics. In space they have been observed almost everywhere 



lisionless 
^ posing 



the problem of reproducingtheir regular occurrence. Formation of power laws has first been 



margins in order to explain the commonality of power law distributions under conditions 
when the plasma is fairly quiet as, for instance, in the solar wind 6|] . They represent a general 
property of slowly evolving quasi-stationary collisionless plasmas (or other systems) far from 
collisional equilibrium but near marginal stability. This raises the question |8| whether those 
systems cannot be described by a version of thermodynamic quasi-equilibrium. Fisk and 
Gloeckler 6| recently provided an important thermodynamic argument for formation of 
an asymptotic canonical power law tail on the distribution f{v) oc from turbulent 
energy cascading with heat flow suppressed. A general physical argument jsj was based 
on the assumption that strongly turbulent interactions in collisionless plasma require the 
Boltzmann collision integral to be modified for which an ad hoc form was proposed. This led 
to the formulation of a generalized Lorentzian statistical mechanics yielding an equilibrium 
distribution with power law tail resembling the observed jl, 2, 3, 4] ^-distributions. 

n 

More specialized mechanisms based on wave particle interaction models [9'] or combina- 
tions of inhomogeneity, plasma flow, radiative transport and residual Coulomb interactions 
js], [l^ also yield power law tails. The approach of Hasegawa et al. oj] is particularly illumi- 
nating. It yields an electron distribution from nonlinear interaction of an electron plasma 
with a photon bath, with power k, being a function of the self-consistent light wave in- 
tensity, applicable to either laser-plasma interaction or high radiation power astrophysical 
objects. Generalizations of thermodynamics based on mathematical ad hoc modifications of 
the Boltzmann- Shannon entropy have been in use for several decades ^|. Among them the 
Renyi entropy enjoys application in chaos theory, while Tsallis' entropy, a variant of a param- 
eterized version proposed by Daroczy lies at the basis of a "non-extensive" thermody- 
namics. Here, using Gibbsian theory, we show that power law distributions and generalized 
Lorentzian thermodynamics under closed homogeneous conditions far from equilibrium may 
arise as the consequence of the violation of the statistical independence of subsystems. 

The starting point in statistical equilibrium mechanics is the Gibbs distribution Wj(ej) = 
A exp(— ej/T), the probability of finding a particle in energy state in the phase space 
volume r'(e') embedded in a large system of temperature (in energy units) T 12|]. It arises 
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from the phase space integral Wi oc J dV 6{€i + e' — E), where E is the average total energy 
of the system, by replacing dT'/de' — exp[5"(e')]/Ae' with entropy S'{€'). The exponential 
dependence on entropy implies that the subsystems are uncorrelated. Phase space elements 
multiply, and S' is additive, i.e. an extensive quantity. This independence breaks down 
in coUisionless plasma turbulence due to the existence of phase space attractors; and S' 
should loose its additive character. In order to maintain the general argument we seek 
for a generalization of the Gibbs distribution, i.e. for properly replacing the exponential 
dependence of the phase space element on S' with another function that in the limit of 
independence of the subsystems reproduces the exponential. Among the many functions 
and distributions serving these needs, the simplest real function with the desired property is 
the generalized Lorentzian with arbitrary constant (independent of e') 'ordering parameter' 

K, 



It reproduces Gibbs' phase space clement for k — > oo. In addition limK_>oo S'^ = S', a 
condition made use of later. Advantage has also been taken of the freedom that for k — > oo 
an arbitrary constant (taken here as 1) can be added to the power k without changing 
the result. The identity with Gibbs' expression in the limiting case is proved by taking 
logarithms. In the above expression S'i^{E) is the constant total entropy which must be 
added in order to avoid an 'infrared catastrophe' at S'^{e') — > 0. 

Expanding the entropy in the integral around its value at total energy E with respect to 
energy in state i yields S'^{E - e^) ~ S'^{E) - ei[dS'^{E) / dE] = S'^{E) - Si/T', with tem- 
perature 1/T' — dS'i^{E)/dE. Solving it yields the probability distribution in the canonical 



The first term in the brackets can be absorbed into temperature and normalization constant 
yielding 



with new subsystem temperature = S'^{E){l—l/i<i)[dS'i^/dE)~^ depending on S'^{E). The 
usual definition of the temperature T recovers for k ^ oo. Due to this unusual dependence 
on total entropy, K-temperatures turn out quite small, in particular for large total entropy. 
Knowledge of the 'real' temperature T' requires determination of the total entropy S'i^{E). In 




(1) 



ensemble 






(3) 
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practical applications this provides a severe complication since the total entropy in this case 
is implicitly expressed through average energy E from the first thermodynamic law. This is 
seen from Eq. (11) below, where S{E) appears in differential form in the temperature and 
also in the normalization integral A, yielding an integro-differential equation for S^{E). 

At large the new canonical probability distribution is a relativistically correct power 
law distribution. Replacing = pf/2m non-relativistically [or relativistically = mc^7(pj)] 
with particle momentum Pj, it becomes power law in p^. It must be normalized to one 
summing over all states. This yields the normalization constant A 



1 + 



1. 



(4) 



It is straightforward to go from discrete probability distributions to classical distribution 
functions by defining a continuous phase space distribution /^(p, cc) with energy variable 
e(p, x) continuous in momentum p and space x, 



f^{p,x) = A 



1 + 



(5) 



and normalization J ff^{p,x)dpdx = 1. In the classical case of constant particle number 
and volume V it replaces the Maxwell distribution [a more conventional choice is normal- 
ization to number density N/V, which requires introducing the s-dimensional phase space 
element (27r^)*] . 

Distributions of this kind have been applied in space plasma physics in various approxi- 
mations. At high particle energies e/nT^ ^ 1, becomes a simple power law distribution 
/^(e) oc e^(^+'^). Its second moment gives the average energy density £ of the system 



S = A 



3 

e2 



1 + 



de. 



(6) 



For reasons of convergence the lower bound /tmin > 3/2 is set on the power law index k, 
translating to marginal flattest (non-relativistic) power law distributions /^(e) oc e^^/^ in 
energy or /^(p) oc in momentum. This theoretical power is in agreement with observation 
and nicely confirms the thermodynamic arguments of Fisk and Gloeckler {gI in the absence 
of heat flux. Nonzero heat flux requires the existence of the next higher moment implying 
oc p^^. The general condition on the value of k for the /th moment oc J p'/^d^p to 
exist (Z = 0, 1, 2, . . . ) is K > |(Z + 1). Power law particle distributions observed in collisionless 
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space plasmas frequently exhibit steeper slopes 3/2</t<lo(2^, suggesting either presence 
of higher moments of or particle losses through real space boundaries. At relativistic 
energies e ~ pc the asymptotic behavior of the distribution function changes to /^(e) oc e~^, 
and the energy distribution exhibits a break at e ^ mc^ changing from power -2.5 to power 
-4. 

So far we dealt with constant particle number A^. It is, however, simple matter to take into 
account variations in in the same way as in Gibbsian statistics, letting the infinitesimal 
phase space volume dF' and entropy S'^{N) depend on A^, with A'q the total particle number. 
Then the delta function in the integral defining Wi also depends on A^ according to 5{ti + e' — 
E, N + N' — Nq), and the integration is with respect to the primed coordinates. Keeping the 
volume constant, the entropy is now expanded with respect to energy and particle number 
yielding S'^{E - ei,N, A^o - A^) ^ S'^{E, No) - e,/T' + 12N/T'. The factor in front of A^ is the 
chemical potential /i = —T'{dS'^/dNQ)Ey- Redefining the temperature as done above, the 
probability distribution function of the grand canonical ensemble becomes 

(6.-/iAr)n-('^+i) 



1 + 



(7) 



The normalization condition now takes into account the summation over particle numbers 
in the different states. 



1 + 



{ej - ^lN) 



1, (8) 



N,i N,i 

first summing over energy states i at constant A^, and then summing over all A^. This 
distribution function cannot as easily as before be transformed into a classical phase space 
distribution function. If, for the moment, we restrict to fixed A^, the distribution in the 
classical limit takes the differential form dw(A^) = /(p^, a;7v)dp^da;7v, and the phase space 
distribution can be determined for the A^th subspace {p^,xn) of phase space. It requires 
knowledge of the analytical form of the quantity underlying the whole theory, viz. the entropy 

In Gibbs-Boltzmann statistical mechanics the entropy is the ensemble average over the 
logarithm of the probability distribution 5* = —([og Wi{N)) . The angular brackets stand for 
the ensemble average ^ Wj(A^) log Wj(A^). Inserting the above ^-probability distribution 
function one realizes the impossibility to obtain the basic thermodynamic relations from 
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this definition. A modified definition of entropy is needed where is given as the ensemble 
average of the logarithm of a functional g[wi^K{N)] of the probability distribution as 



S,^-{logg[wi,,{N)]) 



(9) 



This functional must be chosen such that in the limit k ^ oo it reproduces the grand 
canonical distribution Wi^K{N). With the grand canonical probability distribution the only 
possible choice for g is 



A 



(10) 



with the same normalization constant A as in Wi^^, as it is easy to show that g — > Wi^^iN) 
for K — > oo. Inserting into S^, with average energy (ejiv) = E, one finds that 



S,^-logA + E/T, - fx{N)/T,. 



(11) 



Rearranging just reproduces Gibbs' grand canonical thermodynamic potential = F,^ — 
IJ>{N) — E — T^Sk, — A*(iV") = T^logA or, when using the normalization condition, yields 
expressions for the free energy F,^ and n„, the latter being 



Q, = -r,iog^(i + 

i,N 



(12) 



From this formula the grand partition function follows as the sum of the N canonical par- 
tition functions ^K,Ar 



(13) 



N i,N 

Prom it follow all thermodynamic and statistical mechanical quantities of a k plasma. 

Prom = log A it is straightforward to write down the grand canonical probability 
distribution function 

(e,^-/xiV)n-('^+^) 



1 + 



(14) 



showing that its dependence on in /^-theory is the same as in ordinary Gibbsian theory. 
This allows to write down the phase space distribution function in A'"th subspace as 



{2'Khy 



e(p^,a;jv) - /xiV 



(15) 



where s is the dimensionahty of the A^th subspace. Again, the energy distribution remains 
to be power law. However, now the distribution also depends on particle number N and 
chemical potential /j. which is determined through normalizing to particle number density 
{N)/V when summing up all contributions from the subspaces. This is a formidable task 
that cannot be completed without precise knowledge of the energy states, i.e. e{p^,XN). 

An approximate expression can, however, be obtained assuming that the mean number of 
particles in each subspace is very small. In this case we may write for the mean one particle 
distribution function 

e(pi)-/i" 



1 + 



kTk 



(16) 



which is the generalization of the Boltzmann distribution. Here we have put N — 1 for the 
occupied elements of phase space, retained only momentum dependence and absorbed the 
space dependence (giving a volume factor V) into the factor in front. The dependence on 
chemical potential /i is again retained and is determined through number density {N)/V. 
[In application to measurements the factor 1 — /i/kT,^ can be taken out, leading to another 
re-definition of temperature.] 

We briefly discuss in passing two simple cases that can be constructed from fl^, the cases 
of Fermi and Bose distributions. We write in terms of occupation numbers rii of the ith 
energy level instead of N 



rii 

For the Fermi case rii — 0,1 this becomes 

= -r«logi 1+ 1 + 



(17) 



(18) 



Calculating the average occupation number rii^F — —dflK,F/dii yields the correct Fermi 
^-distribution 

[l + (e,-/i)//€T«]-i 



It has no zero temperature limit except for k ^ oo where it becomes the usual Fermi 
function. The only possible solution with positive chemical potential would be a condensation 
of all particles at one energy level ei — /i, which can be determined from the energy integral 
but is strictly forbidden by the Pauli exclusion principle. (Anyonic occupations would be 
possible, however.) It thus exclusively describes finite temperature states, implying only 



negative chemical potentials /i < —kT^ and thus no degeneration. This is reasonable as 
correlations should occur only at finite high enough temperature. 
For the Bose distribution we sum over all nj = 0, 1, .. . 



There is no way of bringing this into closed form. Clearly, /i < 0. Similar to the Fermi case 
there is no zero-temperature limit and thus also no condensation. One thus concludes that 
the Bose ^-distribution is as well defined only for finite T, which again is reasonable as it is 
defined for correlated states evolving at finite temperature only. 

The present approach is valid for closed homogeneous turbulent systems. It treats k, as 
an ad hoc parameter containing the hidden correlations. It is determined from observa- 
tion and is a function of the power in the turbulent field fiuctuations in stationary tur- 
bulent quasi-equilibrium in the absence of binary collisions. Its functional dependence re- 
quires solving the complete wave-particle dynamics, as was done only for special cases like 
in the work of Hasegawa et al. for electrons interacting with a photon bath. Scudder 
and Olbert ^] include plasma fiow, rudimentary Coulomb collisions, inhomogeneity, non- 
locality and radiation transport in Boltzmann theory to construct power law distributions. 
The thermodynamic approach of Fisk and Gloeckler resembles ours in determining the 
marginal k. In our spirit k evolves slowly until time approaches the binary collision time, 
when it starts diverging explosively and Boltzmann statistical mechanics takes over. For 
t < u^^, K,(t) = Kmin [1 — {'^ctYY^ cau be modeled as an explosive function of time t and 
Coulomb collision time = IQTcNeX^ij/ujpe. The exponent r > 1 controls the strength 
of the transition from turbulent to collisional equilibrium [Ne,ujpe, Xd are electron density, 
plasma frequency, and Debye length, respectively]. For spatial applications it is more con- 
venient to write /t(t) in terms of distance L and collisional mean free path Amfp = V(./ujpe as 
k{L) = Kmin [1 ^ {L / X^fpY]^^ . Deviations of k from Kmin are measures of its evolution. 

We have constructed a statistical mechanical theory of power law distributions via gen- 
eralizing Gibbsian theory, relaxing the assumption of independence of subsystems through 
introducing a generalized Lorentzian form as the simplest real-function generalization of the 
Gibbs function dependence on entropy. It contains an ad hoc ordering parameter n that con- 
trols the strength of the subsystem correlations. Particular forms of entropy and partition 
function have been obtained uniquely as the only means of satisfying the fundamental ther- 




(20) 
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modynamic relations. As classical equilibrium distribution the ^-distribution was recovered. 
It replaces the Boltzmann distribution in correlated coUisionless quasi-equilibria. This theory 
extends classical statistical mechanics to correlated coUisionless systems where subsystems 
are not anymore statistically independent. In such systems the entropy is not additive; it is 
super-additive (or super-extensive) because the interdependence of subsystems contributes 
an extra amount to entropy. This can be shown by direct calculation of the total entropy 
'S'i+2 > S1 + S2 of two subsystems 5"!, 5*2. Moreover, a H-theorem H{t) = J dF/ln g[f] holds. 
Taking the time derivative yields dH/dt — J dT {In g + Sg/gSf} (df/dt) < as the term 
in the braces is always positive. For small deviations from equilibrium and df/dt < the 
system monotonically returns to equilibrium with df/dt = 0. 

Basing the Gibbs-Lorentzian function on counting statistics as in conventional statistical 
mechanics is not in sight. Counting states in equivalence to throwing dices implies statistical 
independence. Breaking independence requires prescription of a particular form of interde- 
pendence of subsystems. Thus any counting, if at all possible, must be model-dependent. 
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